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This paper develops a method to derive optimal portfolios and 
risk premia explicitly in a general diffusion model for an investor with 
power utility and a long horizon. The market has several risky assets 
and is potentially incomplete. Investment opportunities are driven 
by, and partially correlated with, state variables which follow an au- 
tonomous diffusion. The framework nests models of stochastic inter- 
na ■ est rates, return predictability, stochastic volatility and correlation 
P I ' risk. 

In models with several assets and a single state variable, long-run 
portfolios and risk premia admit explicit formulas up the solution 
C^ I of an ordinary differential equation which characterizes the principal 

eigenvalue of an elliptic operator. Multiple state variables lead to 
a quasilinear partial differential equation which is solvable for many 
models of interest. 

The paper derives the long-run optimal portfolio and the long-run 
*^ ' optimal pricing measures depending on relative risk aversion, as well 

21^ , as their finite-horizon performance. 

m 

Introduction. Long-run asymptotics are a powerful tool to obtain ex- 
cn . plicit formulas in portfolio choice and derivatives pricing but their use has 

been mostly ad hoc in the absence of general results. This paper develops 
a method to derive optimal portfolios and risk premia explicitly in a general 
diffusion model for an investor with power utility and in the limit of a long 
horizon. The market has several risky assets and is potentially incomplete. 
^ . Investment opportunities are driven by, and partially correlated with, state 

variables that follow an autonomous diffusion. 

Investment and pricing problems share a reputation for mathematical 
complexity. This common trait is not an accident; the central message of 
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2 P. GUASONI AND S. ROBERTSON 

duality theory^ is that the two problems are indeed equivalent, as state-price 
densities are proportional to the marginal utilities of optimal payoffs. In spite 
of this conceptual equivalence, portfolio choice and derivatives pricing have 
followed largely different strands of literature, each of them with its own 
terminology. 

The portfolio choice literature focuses on finding the intertemporal hedg- 
ing component of optimal portfolios.^ Long-run asymptotics have appeared 
in this literature under different names: the risk-sensitive control approach,^ 
turnpike results^ and large deviations criteria^ are all efforts to achieve 
tractability by means of the long-run limit. 

The derivatives pricing literature strives to identify martingale measures 
that are optimal in the sense of the minimax martingale measure of He and 
Pearson (1991) or the least favorable completion of Karatzas et al. (1991). 
Power utility leads to the g-optimal measure ((Hobson, 2004), (Henderson, 
2005)) which embeds several other martingale measures;^ it reduces to the 
minimal measure for g = 0, to the minimal entropy measure for q = l and 
to the variance-optimal measure for q = 2. 

The advantages of long-run asymptotics are their tractability and ac- 
curacy. Long-run portfolios and risk premia are much simpler than their 
finite-horizon counterparts and allow explicit expressions even in cases in 
which the latter do not. In general, long-run policies are identified by the 
quasilinear partial differential equation (22) which admits explicit solutions 
in several models of interest. In the case of a single state variable, this equa- 
tion reduces to an ordinary differential equation, which is furthermore linear 
if the state variable has a constant correlation with excess returns. The ac- 
curacy of the long-run approach stems from the bounds (27) which estimate 
the duality gap at any horizon and hence the potential departure from the 
unknown finite-horizon optimum. Long-run optimality holds (Definition 6) 
when long-run policies are approximately optimal over long horizons. The 



^See, for example, Pliska (1986), Karatzas, Lehoczky and Shreve (1987), Cox and Huang 
(1989), He and Pearson (1991), Kramkov and Schachermayer (1999), as well as Castaneda- 
Leyva and Hernandez-Hernandez (2005) for a setting similar to the one in this paper. 

^Kim and Omberg (1996), Brennan and Xia (2002), Wachter (2002), Munk and S0ren- 
sen (2004), Liu (2007), compute optimal portfolios explicitly for certain models. 

* Fleming and McEneaney (1995), Nagai (1996, 2003), Bielecki and Pliska (1999, 2000), 
Fleming and Sheu (2000, 2002), Kuroda and Nagai (2002) and Nagai and Peng (2002), 
Hata and Sekine (2005), Kaise and Sheu (2004, 2006). 

'^Leland (1972), Hakansson (1974), Huberman and Ross (1983), Cox and Huang (1992), 
Jin (1998), Huang and Zariphopoulou (1999), Dybvig, Rogers and Back (1999). 

®Pham (2003), FoUmer and Schachermayer (2007). 

'^Logarithmic utility leads to the minimal measure used by FoUmer and Schweizer 
(1991). Exponential utility leads to the minimal-entropy measure Grandits and Rheinlan- 
der (2002), FritteUi (2000), Rheinlander (2005). Mean-variance hedging leads to the va- 
riance-optimal measure introduced by Schweizer (1992, 1996). 
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main result of this paper gives a sufficient condition for long-run optimality 
in a general multidimensional diffusion. Furthermore, this condition is sharp 
for certain models and a calibration to the parameters estimated by Barberis 
(2000) shows that it is satisfied for reasonable levels of risk aversion. 

Two duality insights are central to our results. First, the usual duality 
between payoffs and martingale densities extends to their stochastic loga- 
rithms, which are portfolios and risk premia. Second, long-run asymptotics 
become easier in a duality context because candidate long-run risk-premia 
yield an upper bound on the maximal expected utility and vice versa. This 
observation allows to overcome some difficulties arising in the verification 
theorems of the risk-sensitive control literature. 

An important concept arising in long-run analysis is the myopic probabili- 
ty; a long-run investor with power utility under the original probability beha- 
ves like a logarithmic (or myopic) investor under the myopic probability. This 
probability plays an important role both for long-run analysis and for finite- 
horizon bounds and its existence is crucial for the long-run optimality result. 

The rest of the paper is organized as follows. Section 1 describes the 
model in detail, introducing notation. Section 2 contains the main result: 
a general method to obtain long-run policies in closed form. It also provides 
sufficient conditions, adapted from Kaise and Sheu (2006), for the existence 
of solutions to the associated ergodic Bellman equation. Section 3 discusses 
the various implications of these results for portfolio choice and derivatives 
pricing, and the connections with the stochastic control and large deviations 
approaches. Section 4 derives long-run portfolios and risk premia in two 
models of interest. The last one combines stochastic interest rates, drifts and 
volatilities, and still admits simple closed form solutions. Section 5 concludes. 
All proofs are in the appendices. 

1. Model. 

1.1. Market. Consider a financial market with a risk- free asset S^ and n 
risky assets S = {S^,. . .,S"'). Investment opportunities (interest rates, ex- 
pected returns and covariances) depend on k state variables Y = (Y^, . . . , Y'') 
which model their change over time, 

(1) -^=r{Yt)dt, 

rJQi 

(2) —^=r(Yt)dt + dRl l<i<n. 

Cumulative excess returns R = {R^, ■ ■ ■ ,-R") and state variables follow the 
diffusion 

n 

(3) dRl = fii {Yt) dt + J2 (^ij (Yt) dZl , l<t<n, 
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k 

(4) dV; = bi (Yt) dt + J2 ^ij (Yt) dWi , l<i<k, 

i=i 

(5) d{Z\W^)t = p^jiYt)dt, l<i<n,l<j<k, 

where Z = {Z^, . . . , Z") and W = {W^, . . . , W ) are multivariate Brownian 
motions. This setting provides a flexible framework that nests most diffusion 
models in finance, including the models of correlation risk considered by 
Buraschi, Porchia and Trojani (2010) in which p is a function of a state 
variable. 

The law of (R, Y) determines the drifts b, p and the covariation matrices 

5 = o-d' = d{R,R)t/dt, A = aa' = d{Y,Y)t/dt and T = apa' = d{R,Y)t/dt, 
where the prime sign denotes matrix transposition. By contrast, the matri- 
ces a,a,p are identified only up to orthogonal transformations. The mar- 
ket defined by (l)-(5) is in general incomplete and the covariance matrix 
T'S~^T gauges the degree of incompleteness of the market, highlighting two 
extremes: complete markets for X'S~^T = A and fully incomplete markets 
for T = 0. 

Let S C M'^ be an open connected set. Denote by C™(£^,M'^) [resp., C™''^(£;, 
the class of M'^- valued functions on E with continuous (resp., locally 
7-H61der continuous) partial derivatives of mth order. The superscripts are 
dropped for m = or d = 1, so that C^^^{E,M}) is denoted by C"^(£;,R). 
The following assumption prescribes that the coefficients r, /z,6, ^, S and T 
are regular and nondegenerate. 

Assumption 1. r g CT(^,]R), b £ C^''''{E,R''), p £ C^'^iE,^), A g 
C'^'-y{E,R'''"'), S G C2'T(£;,R"X") and T G C2.t(£;,M"x'=). The symmetric 
matrices A and S are positive definite for all y £ E. 

The region E is typically of the form E = M. x (0, oo) for some < 
d < k, as in the case of multivariate Ornstein-Uhlenbeck processes. Feller 
diffusions or a combination thereof. Fernholz and Karatzas (2005) consider 
models in which E is the open simplex in R*^"^. 

To construct the processes {R,Y), let Q = C([0,oo),M"'^'^') endowed with 
the topology of uniform convergence on bounded intervals. Let B be the 
Borel sigma algebra and let {Bt)t>o be the filtration generated by the coor- 
dinate process X defined by Xt{uj) = ut for oj gQ. For a second-order differ- 
ential operator L of the form in (6) below, a solution to the martingale prob- 
lem for L on M" x £■ is a family of Borel probability measures {P^)x£S."-xE 
on {n,B) such that, for each x G M" x £;, (i) P^(Xo = x) = 1, (ii) P^'iXt G 
M- X Eyt > 0) = 1 and (iii) (/(Xj) - /(Xq) - f;^{Lf){Xu)du;Bt) is a P^ 
martingale for all / G Cq (M" x E) . 

The next assumption ensures that p,b,A,Ti and T identify the law of 
{R, Y). X = (r, y), with r G M", y £ E, denotes the starting points of R and Y . 
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Assumption 2. There exists a unique solution (P'^'''^^)reM",ye£ to the 
martingale problem for 

n+k „2 '^+^ Q 

2 ^ ^ 'dxidxi ^ ^ ' dxi 

Since i?o = for all the models considered in this paper, the measure P^^'^' 
in Assumption 2 is simply denoted as P^ . Henceforth, consider the filtration 
{^t)t>Q defined as Ft = Bt+-, that is, the right continuous envelope of Bt- 
Under Assumption 1 for / G C^(]R" x E), f{Xt) - /(Xq) - jl{Lf){Xu)du 
is a martingale also with respect to J-j; cf. Karatzas and Shreve (1991), 
Section 5.4. 

Remark 3. For consistency of notation. Assumption 2 involves the joint 
diffusion process {R,Y). However, it is essentially an assumption on the 
process Y . Indeed, if Assumption 1 holds, and if there is a unique solution 
{Qy)y(zE to the martingale problem for the operator 

2 .^ dyi dyj ^ dyi 

1,3=1 1=1 

then Assumption 2 holds. To see this fact, first consider the martingale 
problem for the operator associated to {Y,B), where B is an n-dimensional 
standard Brownian motion independent of Y. Then, write Z = pW + pB 
where p is a square root of 1„ — pp' and define the integrals for R in (3) 
accordingly. 

1.2. Trading strategies. An investor trades in the market according to 
a portfolio vr = (7r|)^>o~") representing the proportions of wealth in each 
risky asset. Since the investor observes the state variables Y and the asset 
returns R, the portfolio tt is adapted to the filtration generated by (-R, y), 
and is iZ-integrable.* The corresponding wealth process X'^ = {Xi)t>o fol- 
lows: 

rlX'" 
(8) ^ = r{Yt)dt + ^[dRt. 

Note that a positive initial capital Xq > implies a positive wealth at all 
times, that is, X^ > a.s. for all t > 0, thereby ruling out doubling strategies 
[see, e.g., Harrison and Pliska (1981)]. 



'i?-integrability means each of the integrals J it' fidt, J iv'a dZt is well defined. 
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1.3. Preferences. The investor's preferences are modeled by the power 
utihty function 

(9) U{x) = —, p<l,p^O. 

P 

Denoting by Ep the expectation with respect to P^ , the goal is to maximize 
expected utihty from terminal wealth. With a finite horizon T, the problem 

is 

(10) max-El[(X^)P]. 

T^ P 

Since power utility is homothetic \U{cx) = d'U{x)\, it suffices to consider 
the case Xq = 1 of unit initial wealth. Henceforth, q denotes the conjugate 
exponent to p, 

P 



(11) 



p — 1 



To preserve economic intuition, recall that p = 1 — 7 and q = l — -, where 7 
is the investor's relative risk aversion. Risk aversion increases as q increases 
and as p decreases, and logarithmic utility corresponds to the limit p — t- 0. 

The martingale approach to utility maximization relies on the duality 
between final payoffs and pricing rules, represented by the related concepts 
of stochastic discount factors and martingale measures. 

Definition 4. A stochastic discount factor is a strictly positive adapted 
process M = {Mt)t>o, such that MS is a martingale 

El[MtSl\Ts] = MsSi for all 0<s<t,0<i<n. 

A martingale measure is a probability Q, such that Q\j^t and P^\j^t are 
equivalent for all t € [0,oo) and the discounted prices S^/S^ (or equivalently, 
the excess returns i?') are Q-martingales for all 1 <i <n. 

Martingale measures and stochastic discount factors are in a one-to-one 
correspondence through the relation ^|^|j"t = SfMt, although their distinc- 
tion is important in the present context of stochastic interest rates. Except 
for a complete market in which the martingale measure is unique, the de- 
scription of a pricing rule requires the choice of unhedgeable risk premia rj. 
For any {Tt)t>o adapted, integrable process ry, a candidate (local) martingale 
measure Q^'^ is given by dQ'^'^ /dpy\jr^ = Z^ , where 

(12) Z^ = £(- f {fi'^-^ + T]'T'i:-^)adZ+ f rj'adw) 

and where £{X)t = exp{Xt — 2{X)t)- Clearly, Z must be a martingale for Q^'^ 
to be an equivalent local martingale measure. For such a 77, let Af denote 
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the corresponding stochastic discount factor 

(13) Ml' = exp(- I rdt\£(- j {^x'^^^ +rj'T'^-^)a dZ + I ri'adw\ . 

Note that for any strategy vr and risk premia 77, by (8), the process X^M^ 
is a super-martingale, even if the right-hand side of (12) is only a local 
martingale. For power utility, the following lemma applied to X = X^ and 
M = Mj, for any T > shows that the duality bound is an immediate con- 
sequence of Holder's inequality and of the super-martingale property of the 
process X'^M^. 

Lemma 5. Let X, M be random variables on a probability space (57, J-, P) 
such that X,A4 > P -almost surely and Ep[XM] < 1. Then 

(14) -Ep\xp] < -Epwm^-p 

p p 

and equality holds if and only if Ep[XM] = 1 and, for some a > 0, 
(15) XP-^ = aM. 

Equation (14) bounds the utility of any terminal wealth by a moment of 
any stochastic discount factor and vice versa. The first-order condition (15) 
is the usual alignment of marginal utilities with state-price densities. 

Consider a finite horizon T. Lemma 5 implies that a pair [ir ,r] ) of 
a portfolio vr and risk premia ri such that X = X^ and M = MJI is 
optimal if it satisfies (15) and Ep[X^ Mj, ] = 1. Denoting by uxiy) the 
value function, that is, the maximal expected utility, the following equalities 
hold: 

(16) lEi,[{xfy] = UT{y) = ^EiiiMfy]'-^ 

hence, n is the optimal portfolio and the stochastic discount factor iW 
identifies the pricing rule that makes an investor indifferent between buying 
and selling a small amount of any payoff, including unhedgeable ones. 

1.4. Long-run optimality. In the Markov model defined by (l)-(5), sto- 
chastic control arguments [see, e.g., Pham (2002), among many others], show 
that the pair (vr'^, r]'^) achieving optimality is of the form irf = tt'^{T — t,Yt) 
and rjj = rj^ {T — t ,Yt) for deterministic functions 

TT^ : [0, T] X £; h^ M" 7?^: [0,r] x^h^M^ 

Thus, optimal policies depend on both state variables and the residual hori- 
zon. This joint dependence is the major source of intractability in portfolio 
choice and derivatives pricing problems. 
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Brandt (1999), Barberis (2000) and Wachter (2002) report that optimal 
policies converge rapidly to functions of state variables alone. Thus the 
optimal policy for a long horizon [0,T] is approximately equal to a time- 
homogeneous function for most of the interval, departing from it as the 
horizon T approaches. The question is whether using a time- homogenous 
policy throughout the interval [0,T] can be approximately optimal. 

For any functions vr G C{E,W^), rj € C{E,'R.'') consider the portfolio vr = 
{TT{Yt))t>o and risk premia r] = {rj(Yt))t>o- At any finite horizon T, the du- 
ality bound (14) implies that 

(17) ^EliiX^r] < UT{y) < ^-Eim^Y]'-^ . 

The first inequality reflects the potential gap between the utility of the long- 
run portfolio and the value function. A tangible measure of this gap is the 
increase in the risk- free rate It required to recover this loss, as to match 
the expected utility of the long-run optimal portfolio under the higher rate 
with the maximum expected utility at the regular rate. This is the certainty 
equivalent loss, defined as 

(18) -Eyp[ie^-^X^r] = UT{y). 

p 

Substituting (18) into (17) yields an upper bound on It 

(19) It <^(^^logEyp[{M^n-P _ ^iogi?^[(X?)^: 

This argument motivates the definition of a pair (7r,r/) as long-run optimal 
when its certainty equivalent loss vanishes for long horizons. 



Definition 6. A pair (7r,r/) G C{E,W) x C{E,M.'^) is long-run optimal 
if, for all y ^ E, 

(20) hmsnp-(hogEyp[iM^y]^~P-hogEyp[{X^r]) =0. 

Long-run optimality defined here is essentially equivalent to the criterion 
used by Grossman and Vila (1992) to solve portfolio choice problems with 
leverage constraints. Grossman and Zhou (1993) apply the same idea to 
drawdown constraints and Dumas and Luciano (1991) to transaction costs. 
The risk-sensitive control literature studies a similar objective for multidi- 
mensional linear diffusions. 

Definition 6 departs from the existing literature by examining both the 
primal (investment) and the dual (pricing) problems. This perspective yields 
verification theorems that are valid for general multidimensional diffusions, 
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provides estimates on finite-horizon performance and allows to identify the 
parameter sets for which long-run optimality holds. 

Definition 6 allows another interpretation based on management fees: an 
investor with sufficiently long horizon prefers a long-run optimal portfolio to 
the optimal finite- horizon portfolio if the long-run portfolio has slightly lower 
fees. The argument is straightforward: suppose that the portfolio vr requires 
the payment of a (continuously compounded) fee (/?, while the finite-horizon 
portfolio ttt entails a higher fee ipx > </?. Accounting for such fees, the port- 
folio vr has expected utility ^E^p[{X7^e~'^'^y]. However, by the bound (14) 
the finite-horizon portfolio ttt satisfies 

Hence, vr is preferred to ttt when 

(21) ^T-^>-^fy^\ogEl[{M^^Y]^-^-^\ogEyp[{X^Y]^. 

For a long-run optimal pair (vr,?^), the limit of the right-hand side is zero. 
Thus, for any minimal difference in fees, a long-run optimal portfolio is 
preferable for investors with sufficiently long horizons. 

2. Long-run analysis. The construction of long-run optimal portfolios vr 
and risk premia r/ takes place in two steps. In the first step, Theorem 7 com- 
putes the finite-horizon performance of the long-run optimal "candidates" vr 
and r]. In the second step. Theorem 9 establishes a sufficient condition for 
long-run optimality, requiring that the bounds found in the first step con- 
verge at long horizons. 

The candidate long-run optimal vr and r] crucially depend upon the so- 
lution of the quasi-linear partial differential equation (PDE) in (22), which 
acts as a long-run version of the Hamilton-Jacobi-Bellman equation. Thus, 
Theorems 7 and 9 are akin to verification theorems of stochastic control the- 
ory, but for the asymptotic objective in Definition 6. An advantage of these 
results is that they only rely on the local properties of the processes {R,Y), 
avoiding the knowledge of the transition density of 1", which may be very 
complicated if known at all. 

The second part of this section studies the existence of solutions to the 
ergodic Bellman equation in (22). Theorems 13, 18 and Proposition 15 below 
adapt the results of Kaise and Sheu (2006) to the present setting and under 
some extra conditions in addition to the assumptions of Theorems 7 and 9. 
Their main message is that the quasi-linear PDE generally admits only one 
candidate for long-run optimality. As shown with examples in Section 4, this 
candidate may or may not be long-run optimal. 
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2.1. Main results. Recall that, although their dependence on y is omitted 
to alleviate notation, b, fi, S, T, A, (j) and v are functions of the state 
variable y. 

Theorem 7. In addition to Assumptions 1 and 2, assume that: 

(i) V E C^(£',]R) and A G M solve the ergodic HJB equation (cf. Sec- 
tion 3.2) 

pr - ^;u'S- V + -^v'{A - qT'^-^r)Vv 
(22) 

+ Vv'{b - gT'S" V) + 2 H^D^v) = A; 

(ii) there is a unique solution (P^'y)r£R^^y£E to the martingale problem 
for 

2 ^^ ^ ' dxidx^ ^ dxi 

(23) 

^--(/. + TV.) 

b - gT'S^V + {A- gT'S-iT)Vu^ 
where A is as in (6). 
Then, the pair (vr, r/) given by 

(24) 7r = S"^(/i + TVt;), r? = Vv 

1— p 

satisfies the equalities 

(25) Ell^X^f] = e^^+''(?')£:|[e-^(^^)], 

(26) ^|,[(M^)«]i-P = e^^+''(?')^^[e-(i/(i-P)>(^^)]^~P. 

Remark 8. Equations (25) and (26) provide lower and upper bounds 
on finite-horizon expected utility. Indeed, the duality inequality (14) yields 

\^^T+v(y)^yJ^-v[YT)^^ = -El[{X^Y]<UT{y) < -EliiM^W-P 
p ^ p p 



}i^XT+v{y)^y^^-{l/{l-p))v{YT)^l-p^ 



p P 



Combining (25) and (26) with (19) yields the central quantitative implica- 
tion: an upper bound on the certainty equivalent loss 

(27) Ir < i(ilogi?|[e-(V(i-p)>(^.)]i-^ - ilog£;^[e-(^-)]) . 



(28) F = < 
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Theorem 7 now reduces the long-run optimahty (Definition 6) of (vr, rf) to 
the condition that the right-hand side in (27) converges to zero. Theorem 9 
below provides a criterion that covers most applications and Proposition 25 
below shows a model in which this criterion is sharp, in that it holds for all 
the parameter values for which long-run optimahty holds. 

Theorem 9. If, in addition to the assumptions of Theorem 7: 

(i) the random variables {Yt)t>o ore P^-tight^ in E for each y G E; 
(ii) supyg£;F(y) < -|-oo, where F G C(-E,]R) is defined as 

(pr-\- ^fi'^-^fi + ^Vv'T'^-^TVv) e-^ p < 0, 

fpr-X- ^/x'S- V - -yv'{A - r^-'T)Vv) e-(i/(i-p))-, 

0<p<l. 

Then the pair {iT,ri) in (24) is long-run optimal. 

Section 4 shows how to check conditions (i) and (ii) in typical classes of 
models. 

Remark 10. A sufficient condition for (i) above to hold is that there 
exists a nonnegative ip S C{E,M.) such that, for each n, the level set Kn = 
{y £ E : ip{y) <n} is compact and that M = supf>o E^~[ilj{Yt)] < oo. If such 
a tp exists, then Markov's inequality implies that, for each n 

snppy{Yt G K) <-supEl[i;{Yt)] = — . 
t>o n t>o ^ n 

Thus, py tightness in E follows. 

2.2. Solutions to the ergodic Bellman equation. This subsection provides 
conditions for the existence of a solution pair (f,A) to (22), such that the 
tightness condition in Theorem 9 holds. These results are obtained adapting 
the arguments in Kaise and Sheu (2006) to the present setting. Define A as 
the set of A G M for which a solution v to (22) exists, 

(29) A = { A G M I 3w E C'^'^{E, R) solving (22)}. 

A depends both on the region E and on the coefficients in the PDE (22). The 
foregoing results require the following assumption on the region E, which 
holds in virtually all models in the literature. 



^Recall that a family of _B-valued random variables {Xt)t>o is P-tight in E if the induced 
measures (P o Xl[^)t>o form a tight family in M\{E), the space of Borel measures on E. 
Thus, {Xt)t>o is P-tight in E if for each e > there exists a compact K^ C E such that 
sup,>oP(Xre/^?)<e. 
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Assumption 11. There exist yQ £ E and a sequence of bounded open 
subsets En C E, star-shaped^'^ with respect to yo and with a C^''^ boundary, 
and strictly increasing to E, in that E = IJ^i ^n and £■„ n (£' \ En+i) = 0. 

This assumption is satisfied by any convex set E for which there is a con- 
vex function ip G C'^''^{E, M) such that V'(y) t oo as y — )• Si?. In this case, it 
suffices to set En = {y £ E : ip{y) <n}. The next assumption requires that 
the potential pr — ^fj-'Ti^^fi is bounded from above. When it does not hold, 
solutions to (22) may not exist [Pinsky (1995), Chapter 4.5]. 

Assumption 12. supy^^iP'i^i.y) ~ i/^iyy^iv)'^ Kv)) < oo- 

Note that Assumption 12 always holds if p < 0, and the interest rate r 
is bounded from below, which is a typical situation in financial models. 
With Assumptions 1, 2 and 11, denote by {R,Y) the coordinate process 
of the solution {py)y^E of the martingale problem corresponding to the 
operator L from (6). Regarding the state variable y, the statement of ex- 
istence results requires a few basic definitions in ergodic theory [see Pinsky 
(1995), Pinchover (1992) for more details]. Y is transient if P^iY is eventu- 
ally in ii^ \ En for all n > N{oj)) = 1 for all n > 1 and y £ E. Y \s recurrent 
if P^{T{e,y) < oo) = 1 for all x,y £ E and e > 0, where T{e,y) = inf{i > 
I |lt — y| < e}. IfY is recurrent, there exists some (j)> such that Lcp = 0, 
where L is the formal adjoint to L. y is positive recurrent, or ergodic, if 
f ^ (j) dy < oo, and null recurrent otherwise. If Y is positive recurrent and (/> 
is normalized to be a probability density, then for all y £ E and / £ L^{E, </>) 

(30) Vim El[f{YT)]= f f~4>dx. 

noo Je 

If y is ergodic, then (30) implies that Y is P^-tight in E for each y £ E, and 
for all y G £' and (tn)n>i t co, the measures {P^ o Yt^)~^ weakly converge 
to the measure with density (j), which does not depend upon the starting 
point y £ E. With these definitions and results, the following theorem shows 
that there exists only one possible pair {X,v), solving (22), which can lead 
to long-run optimality. 

Theorem 13. Let Assumptions 1, 11 and 12 hold. Then there exists 
Ac G M such that A = [Ac, cxo). Furthermore, Y is {py)y^E-transient for any P 
corresponding to a solution {v,X) of (22) with A > Ac. 

Clearly, {py)y^E transience and (P^)yg£;-tightness in E are incompati- 
ble with one another. Furthermore, since ergodicity implies tightness, the 



^"Recall that F <ZR'^ is star-shaped for some xq G F if for each x £ F the segment 
{axo + (1 — a)x; < q < 1} is contained within F. A convex set is star-shaped with 
respect to any of its points. 
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question is whether the pair {Xc,Vc) makes Y ergodic under {py)y^E- The 
foUowing results give conditions under which this is indeed the case. The first 
proposition is vahd for a single state variable and constant correlations p. In 
this case, (22) linearizes under a power transformation, and classical tests for 
transience and recurrence of one-dimensional diffusions apply. The second 
proposition considers the general multidimensional case but under a stronger 
restriction on the potential term. 

2.2.1. One state, constant correlations. An important case leads to sub- 
stantial simplifications. 

Assumption 14. Let Assumptions 1 and 12 hold. Further, assume that: 

(i) E = (q, /3) with -oo < a < /3 < oo. 
(ii) p' p = T'S^^T/yl is constant. 

Note that Assumption 11 is always satisfied for a single state variable. Set 

1 



(31) 5 = 

1 - qp'p 

The change of variable (p = exp(u/(5), essentially equivalent to the power 
transformation of Zariphopoulou (2001), reduces the quasi-linear ODE in (22) 
to the linear ODE 

(32) 4-^ + (6 - gT'S- V)<^ +-iV-X)^ = 0. 
2 

Let A G A and let tp G C'^'^{E, M) with (/> > be a solution to (32) obtained 

by i;^ = exp {v/5) . Under P^ , Y has the dynamics 



(33) 



dYt= (b-qT'^-^p + A^jdt + adWt. 



Using Feller's test for explosions, the following proposition [Pinsky (1995), 
Corollary 5.1.11] gives sufficient conditions for Y to be P^-tight in E for the 
candidate optimal pair (Ac,(^c)- 

Proposition 15. Let Assumption I4 hold, let {Xc,Vc) be as in Theo- 
rem 13 and let (pc = exp{vc/5). Denote by 

, 1 1 f rSlt-gT'E-VXa),, 
P4) »„(.) = 3jjjjexp^^ — d. 

where yo G (a,/3). Then, the family of random variables {Yt)t>o is P^ -tight 
in E if and only if 

ryo 1 /■'^ 1 f^ 

(35) / -Tl dy= / -J- dy = 00 and / (plm^dy < 00. 
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2.2.2. The general case. This subsection treats the general case of k state 
variables under the following assumption. 

Assumption 16. There exists a function w e C'^''^{E,M) such that 

lim sup ( pr — -/x'S~ ijl + -Vw {A — qT'll~ T)Vw 

ntoo E\E„ V 2 2 

+ Vw'{b - gT'S" V) + I ti{AD^w)\ = -oo. 



'E\E, 

(36) 



Remark 17. For general regions E, condition (36) plays a similar role 
as condition (A3) in Kaise and Sheu (2006). Assumption 16 is satisfied, for 
example, when 

(37) lim sup ( pr /i'S^ fi ) = — oo. 

"too E\E„ V 2 J 

In this case, w =1 satisfies (36). 

In this setting, the main existence criterion is the following. 

Theorem 18. Let Assumptions 1, 11, 12 and 16 hold and let {Xc,Vc) be 
as in Theorem 13. Then v^ is unique up to an additive constant and (li)t>o 
is py -tight in E for all y £ E. 

Proposition 25 in Section 4 below shows that long-run optimality may still 
fail, even when the tightness condition is satisfied for the pair (Xc,Vc). The 
reason is that, even if Y is ergodic under (py)y^E with invariant density cj), 
the ergodic property in (30) may not hold for (25) and (26) because the 
functions 

(38) exp{-v{y)), exp(-(l -p)"^u(y)) 

therein may not be in L^{E,(j)). Thus, long-run optimality requires addi- 
tional assumptions, such as (28) in Theorem 9. 

If the functions in (38) are in L^{E,(j)), then (30) yields additional infor- 
mation about the speed at which the certainty equivalent loss It converges 
to zero in the limit of a long horizon. The following proposition provides such 
a result, in the case of a single state variable. Recall that risk aversion is 
7 = l—p= 1/(1 — g). The main message is that long-run optimality may fail 
only for (i) high risk aversion and highly incomplete market or (ii) low risk 
aversion and nearly complete market. In particular, for —l<q< 1/2 (i.e., 
risk aversion within 1/2 and 2), long-run optimality holds for any level of 
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incompleteness. In addition, for q > 1/2 (resp., q < —1), long-run optimality 
holds if p'p < 1/2 (resp., p'p > 1/2). 

Section 4 takes up this issue in specific models, obtaining necessary and 
sufficient conditions. By contrast, the following sufficient condition holds 
under general assumptions, regardless of the model considered. 

Proposition 19. Let Assumption 14 hold, and assume that rriu in (34) 
satisfies J^m^dy < oo. // (Ac,fc) are such that Y is {P'^)y^E-e-rgodic, then 
long-run optimality holds if 



(39) 



ppe < 



0,1], 
' 1 + g 
2q ' 



for -<q<l, 



for 

for q < —1. 



l<q<-,q^O, 



In such cases, there exists a constant K > such that the certainty equivalent 
loss It satisfies 



(40) 



0<limsupT/T<K. 

Ttoo 



The next corollary states in an important special case, which does not 
even require the knowledge of the principal eigenfunction (p, since m^ only 
depends on the model parameters. 

Corollary 20. Under Assumption I4, if J^m,^dy < 00 and (37) are 
satisfied, then long-run optimality holds for q and p'p satisfying (39). 

3. Implications and ramifications. 



3.1. The myopic probability. The bounds (25) and (26) in Theorem 7 and 
assumption (i) in Theorem 9 depend on the equivalent probability P^ , which 
plays a pivotal role in long-run analysis. In general, P^ is neither the physi- 
cal probability P^ nor a risk-neutral probability. Instead, its interpretation 
becomes clear from its dynamics, which is (for P-Brownian motions Z, W) 

dRt = (/i + TVw) dt + a dZt, 



1 



P 



dYt = (6 - gT'S- V + (^ - gT'S-iT)Vv) dt + adWt. 

Compare the original model, with price dynamics under P^ and power util- 
ity x'P /p, to the auxiliary model under P^ with logarithmic utility. The 
long-run optimal portfolio in the two models coincide. The first one is sim- 
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ply in (24), while the second one follows from the usual formula vr = S^^/i, 
where fi = Y:rz{lJ' + TVf ) are the expected returns under P^ . Thus a long 
horizon, power-utility investor under the probability P^ behaves exactly as 
a myopic (or logarithmic) investor under P^ . 

This observation shows that P^ corresponds to the long horizon limit of 
the probability R considered by Kramkov and Sirbu (2006a, 2006b, 2007) in 
finite horizon, in the context of sensitivity analysis pricing of option prices. 
Cerny and Kallsen (2007) study mean-variance hedging for semimartingales 
and obtain optimal strategies in terms of the predictable characteristics of 
asset prices under an opportunity neutral probability P* , which is similar in 
spirit to py , in that it reduces the mean-variance objective to a logarithmic 
utility objective. 

3.2. Connections with stochastic control. Since the work of Merton (1969), 
most of the dynamic portfolio choice literature has employed stochastic 
optimal control as its main analytical tool. The relation between Theo- 
rems 7, 9 and the stochastic control approach becomes clear by comparing 
equation (22) to the Hamilton-Jacobi-Bellman (HJB) equations of the util- 
ity maximization problem (10). Its value function u{x,y,t) depends on the 
current wealth x, the current state y and time t. The homogeneity of power 
utility entails that u{x,y,t) = x^e^^^'^' /p, thereby removing wealth from the 
reduced value function w. The corresponding HJB equation becomes [see, 
e.g., Pham (2002)] 

(41) "^^ ^ ^ 

+ Vw'{b - qT'j:-^n) + ^ tT{AD^w) 

with the terminal condition w{y,T) = 0. Instead, the main PDE (22) is 
X=pr- l^i'S- V + l^v'{A - qT'j:~^T)Vv 

+ Vv'{b - gT'S" V) + ^ tiiAD^v). 

In the former equation, the unknown function w depends on both time t and 
the state y, while v in the latter equation only depends on the state, although 
the constant A is also unknown. Indeed, the former equation reduces to the 
latter under the restriction 

w{t,y) = X{T-t) + v{y). 

This restriction gains analytical tractability by reducing the dimension of 
the problem. The price of the tractability gain is that solutions of the time- 
homogeneous equation in general do not satisfy the boundary condition 
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and, therefore, are not exactly optimal at any time-horizon (except in the 
trivial case v = 0, arising with logarithmic utility or constant investment 
opportunities). 

A special case of equation (22) appears in the risk-sensitive control ap- 
proach to optimal investment initiated by Bielecki and Pliska (1999). In 
a linear diffusion model, they study the problem 

(42) maxliminf;^log^[(X|;)P], 

where the supremum is taken over all progressively measurable strategies. 
Risk-sensitive control relies on control techniques to establish the existence 
and uniqueness to the homogeneous equation, then attempts to establish 
its optimality in the sense of (42). Fleming and Sheu (2000, 2002) carry out 
this program under the assumption that |p| is small, that is, if risk aversion 
is close enough to the logarithmic case. The results in this paper, which 
apply to general nonlinear models, shed new light on this literature by char- 
acterizing finite-horizon performance. For example. Proposition 25 below 
relaxes the restriction of \p\ small to a necessary and sufficient condition 
and explains the economic intuition behind it. 

3.3. Long-run q-optimal measure. For each value of the risk-aversion pa- 
rameter 1 — p, the risk premia r] in (24) deliver a pricing rule for derivatives 
involving the partially unhedgeable state variable Y. The martingale mea- 
sure Q^ corresponding to the risk premia rj is a long-run version of the 
minimax martingale measure of He and Pearson (1991), called g-optimal 
measure by Hobson (2004) and Henderson (2005). Its formal dynamics is 

(43) {dRt = adZt, 

for some Brownian motions Z and W . Since this dynamics is distinct from 
the one under P^ and P^, in general it is necessary to check its well- 
posedness, in the form of Assumption 2. 

Observe that the drift of Y under the g-optimal measure has three com- 
ponents. The first term h is the drift under the original measure P^ . The 
second term T'S~^// is the risk-neutral adjustment due to the correlation 
between the returns and the state shocks. The last term {A — T'S~^T)Vf 
accounts for preferences which enter the equation through v. 

3.4. Complete and fully incomplete as duals. The formulas in (24) high- 
light the symmetric aspects of complete markets, where A = T'E~^T iden- 
tically and fully incomplete markets, where T = 0. In a complete market the 
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pricing problem is trivial, as the dynamics in (43) becomes independent of 
the preference parameter p, 

/^^N (dRt = adZt, 

^ ' \dYt = {h-ri:-^ii)dt + adWt. 

However, the investment problem is nontrivial because the optimal portfolio 
includes a component that perfectly hedges the state variables. 

Conversely, in a fully incomplete market, myopic portfolios are optimal 
because all portfolios evolve orthogonally to state variables. However, a la- 
tent hedging motive remains present and generates nonzero risk premia for 
state variables, which have a potential as hedging instruments. In both cases, 
it is market dynamics, and not preferences, which make either the invest- 
ment or the pricing problem trivial. By contrast, logarithmic preferences or 
constant /i and a remove the intertemporal hedging motive entirely, making 
both problems trivial. 

The quasi-linear ODE in (22) becomes linear under a transformation in 
both the complete and fully incomplete cases, as in the one state variable 
case discussed in Section 2.2.1. In the complete case, the transformation 
(j) = e^^"*?)" leads to the linear equation 

(45) ]- tr(AL>V) + V(/>'(6 - gT'S^ V) + (1 - «) [pr - |m'S^ V - A j = 0. 

In the fully incomplete case, the transformation (j) = e" leads to the linear 
equation 

(46) ]- ti{AD'^<j)) + V0'6 + (pr - |/i'S" V - A j (/) = 0. 

The criticality theory of Pinsky (1995) applies to these cases under multi- 
variate restrictions similar to those given in Assumption 14, with 5 = j:;- in 
the complete case and 5 = 1 in the fully incomplete case. Furthermore, the 
multivariate results of Theorem 18 apply as long as (36) can be verified. 

3.5. Long-run decomposition. The bounds (25) and (26) decompose ex- 
pected utility and its dual into a common "long-run" component e , and 
two "transient" components, in a close analogy to Hansen and Scheinkman 
(2009). For a multiplicative functional A^ of a Markov process Y , they pro- 
pose the decomposition 

(47) iV, = exp(^i)^iVi, 

where p and ip are, respectively, the principal eigenvalue and eigenfunction 
of the infinitesimal generator of Y and Nt is a martingale. The bounds (25) 
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and (26) yield similar expressions for terminal utilities and their dual coun- 
terparts 

^■"iy) fipy / p'"iy) \^I^^~p) Apy 

^^^' -^ e-iyT)dpy ^ ^' "V e-o-T)) dpy 

These decompositions are precisely of the form in (47), with the difference 
that on the dual side the transient components are powers of e" , as opposed 
to e" itself. Note also that the operator in (22) is not the generator of Y 
under either P^ or P^, since it is nonlinear, has nonzero potential and has 
a different drift. Further, the interpretation of e^"^ as a long-run component 
hinges on the condition that the P^-expectation of transient components has 
a less than exponential growth, which means that long-run optimality holds. 
This is not always the case; the examples in Section 4 show how parameter 
restrictions are necessary even in the most common models. 

3.6. Large deviations. Theorems 7 and 9 are closely related to the re- 
sults of Donsker and Varadhan (1975, 1976, 1983) on large deviations of 
occupation times for diffusions. Though the results also hold in the multi- 
dimensional case of fc > 1 state variables, the following discussion considers 
a single state variable for simplicity of notation. 

Let E = (a,/3) for — oo < q < /3 < oo and consider a diffusion Y with 
generator LX from (7) (with fc = 1), assuming that the coefficients A and b 
are such that Y is positive recurrent under {py)y^E- Let m be the invariant 
measure which has a density by (30). With a slight abuse of notation, let 
m{dy) = m{y) dy. 

Denote by Mi(a,/3) the space of Borel probability measures on (a,/3). 
Under certain conditions on 1", Donsker and Varadhan show that, for all 
continuous bounded functions F : (a, /3) i— )• M and all y G (a,/3), 



(48) hm l-logEl 

1 -T'CxO 1 



exp(f V{Yt)dt 



sup ( / Vdfi — I{fi) 

MeMi((«,/3)) 



For fi € Ml (a,/?) absolutely continuous with respect to m (and hence, the 
Lebesgue measure) and with density /i(y) such that V'(y)^ = f^{y)/i^{y) satis- 
fies certain regularity and decay conditions, the rate function I{^) reduces to 

1 [^ 
I(^) = - / A{4)fmdy. 



2_ 

Using this representation for the rate function, the following heuristic argu- 
ment shows the relation between the Donsker and Varadhan (1975) theory 
and long-run optimality. Consider the terminal utility of a portfolio 7r(Yi) 
for some function tt : E h^ M", 

{X^y = exp n (pr + p-K'fi + ^p{p - l)^'S7r j dtjsf f pir'a dzA . 
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Define P^ by setting jp^ equal to the stocliastic exponential in the last term 
of this equation. It follows that 



exp / i pr + pTr' ^ + -p{p — 1)tt' Utt \ dt \ 



Assuming they may be applied under P^ , the Donsker and Varadhan asymp- 
totics (48) yield 



lim hogEy,[{x^y] 

1 ^-oo 1 



(49) 



sup / ( ( pr + ptt' fi + -p{p — l)7r'S7r j ip 



A{^) ]mj,dy, 



where mjr is the invariant density of Y under P^ and L\{mT^) is the unit 
disc in L^(?7i^). In a similar manner to (34) in Proposition 15, m^r admits 
the formula 

Here, yo is some interior point in E. To make the dependence on the port- 
folio TT explicit, the change of variable ip'^rriT^ = (fp"my yields [rriy is defined 
in (34)] 



ip (f) rhp 



m 



- = ^ - A-i (gT'S^ V + pT'vr) 



tp (j) ' 2my 2m,r v 
Substituting (50) into (49), the utility growth rate becomes 



(51) 
where 



sup / (vr'Avr + vr'B + C)(^^mj, dy, 



(p&L\(mv) 



1 



A = ^p{p-l){T.-qTA-^r) 



C = pr--A 



+ q^iT; T- 



B =p( (In - qTA-'rl:-')^l + T J 

-gV'S-^TA-irS-V- 



The integrand is a quadratic function of tt and achieves its optimum at 

1 



(52) 



TT : 



I-P 



T,-H^^ + 5T'^]. 
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Thus, substituting (52) into (51), the utihty growth rate reduces to 

(53) sup / iipr--n'T,-'^fi]cl)'^--A{<j)f]m^dy. 

4><^Ll{m^)Ja VV ^ / ^ / 

A similar reasoning on stochastic discount factors dehvers the candidate 
long-run risk premia. The Euler-Lagrange equation associated to (53) is the 
ODE in (32). Thus, large deviations arguments act as a guide for producing 
the candidate long-run optimal policies. 

This argument, which explains the formal connection with large devia- 
tions, is suggestive but only heuristic. The main reason is that the Donsker- 
Varadhan asymptotics are correct under some delicate conditions which may 
fail to hold even in the simplest models. 

4. Applications. This section applies the main results to two models, as- 
suming that the investor is more risk averse than the log investor (p < 0). In 
the first model, the state variables follow a multivariate Ornstein-Uhlenbeck 
process that drives the drift of the return process. Under general conditions, 
this model admits a unique solution v to (22), leading to P^ tightness. For 
a single state variable, long-run optimality is characterized in terms of pre- 
cise parameter restrictions. 

In the second model, interest rates, drifts and volatilities are stochastic. 
Each of these quantities is afhne in a single common state variable, which 
follows a Feller diffusion. Although this model does not belong to the afhne 
class, the long-run optimal portfolios and risk premia have very simple ex- 
pressions. 

The parametric restrictions required by long-run optimality lead under 
each single variate model to the same economic interpretation. Long-run 
optimality does not hold at the conjunction of three extreme situations: 
(i) high covariation between risk premia and state variables, (ii) nearly com- 
plete markets and (iii) high risk-aversion. To understand this phenomenon, 
recall that long-run optimality means that a time-homogenous strategy is 
approximately optimal on a long time interval. Thus, the sub-optimality of 
the long-run strategy in the latest part of the interval must lead to a small 
utility loss. Since the myopic component of the optimal finite-horizon portfo- 
lio is time-homogenous, any loss in utility is attributed to the intertemporal 
hedging component. All of the three extreme situations mentioned above 
concur to amplify the intertemporal hedging component. First, the covaria- 
tion of risk premia is proportional to the hedging portfolios S~^T. Second, 
intertemporal hedging is more attractive in a nearly complete market, where 
state variables are almost replicable. Third, intertemporal hedging is higher 
for more risk-averse investors who reduce long-term risk at the expense of 
short-term return. 
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4.1. Linear diffusion. This is the most common multivariate model, with 
constant covariance matrices Ti,T,A and drifts r,fi,b that are affine func- 
tions of the state variable. The dynamics is 

dRt = {no + fJ'iY't) dt + a dZt, 
, . dYt = -bYtdt + adWt, 

^ ' ^ d{R,Y)t = pdt, 

r{Yt) = ro + r[Yt, 

where /xq G ^"', l-ii G IR"""^', o- G M'^^'", b G M^^*^, a G R'''"', p G ffi"'''^, tq G M 
and ri G M . Under this model, E = 'Ur and state variables follow a multi- 
variate Ornstein-Uhlenbeck process. This setting is considered in most of 
the literature in risk sensitive control mentioned in the Introduction and 
it is also implicit in the use of vector autoregressions in the econometrics 
literature. The coefficients in (54) satisfy the following. 

Assumption 21. All four matrices S = aa' , /i'lZ-ti, b + b' and a are pos- 
itive definite. 

Assumption 21 implies that condition (37) holds for p < 0. Hence, by 
Theorem 18 [or by the results in Kaise and Sheu (2006)], there is a unique 
pair (A, v) solving (22) such that for each y £ E, (lt)t>o is P^-tight in E. 
The next theorem shows that v is in fact quadratic. 

Theorem 22. Let Assumption 21 hold for the model in (54). For p < 0, 
equation (22) admits a unique solution v such that for each y G M , (l^)t>o 
is P"^ -tight in M . The solution is of the form v{y) = v^y — 2y'viy, where the 
symm,etric matrix vi G M'^^*' and the vector vq G M^ and satisfy the algebraic 
equations 

{vi{A - qT'j:-'T) + {b + gT'S- VOO^'o - pri 
(55) 

+ q{pi-viT')i: Vo = 0, 

vi{A - qT'j:~^T)vi +viib + (zT'S- Vi) + ib + gT'S" Vi)V 
(56) 

- qn'iH Vn = 0. 

The corresponding utility growth rate equals 

X=pro- -^UgS" Vo + ttWo(^ - qT'T.~^T)vo 
^^^^ /, 1 

Equation (56) is a quadratic equation in the unknown matrix vi and it 
belongs to the class of matrix Riccati equations which arise in filtering theory 
and dynamical systems. It does not admit a closed-form solution in terms 



(58) 
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of matrix operations but numerical techniques for obtaining the solution 
are available [see Abou-Kandil et al. (2003), Chapter 2]. Once the matrix vi 
is known, the linear equation (55) yields a unique solution for vq and A is 
quadratic in vq and linear in vi. 

Observe that Theorems 22 and 7 characterize the candidate pair (vr,?]), 
and allow to find the finite- horizon bounds, but do not address long-run 
optimality. This stronger property, in fact, holds only under parameter re- 
strictions and is now studied in detail for a single state. In this case, the linear 
diffusion yields an extension of the models in Kim and Omberg (1996) and 
Wachter (2002), 

dRt = {(JUq + baviYt) dt + a dZt, 
dYt = -hYtdt + dWt, 
d{R,Y)t = pdt, 
, r{Yt) = ro. 

The constants are the same as in (54) except that here /io = o'l^Oj ^i = bai'i 
where fo,i^i S M", for ease of notation. Note that a = 1 and ri = 0. The 
Riccati equation from (56) is 

6~^vl + 26(1 + qpiyi)vi - qb^u[ui = 

for as in (31). Under Assumption 21, for p < 0, the solution vi,vo,X from 
Theorem 22 is 

(59) vi=5b{Ve-{l + qp'iyi)), 

(60) Vq = qSp'uQ j={qu[vQ + q5p'vQ{l + qp'i^i)), 



(61) X = prQ- -quQUo + ^'^'^^o " QVopi^o - -vi, 

where 

(62) e={l + qp'uif + 6~\u[ui. 

The candidate long-run optimal pair (vr, rj) is affine in the state variable 

7r(y) = :; S~^(^(y) + voap - viyap), 

1 — V 

(63) 

v{y) = vo- viy 

and the dynamics of (1", R) under the candidate long-run martingale measure 
are 

dRt = a dZt , 



^*^^^ \ dYt = i-bYt - p'a~^p + (1 - p'p){vQ - viYt)) dt + dWt. 

This pair (vr, r]) is indeed long-run optimal but only under a parameter re- 
striction. 
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Proposition 23. Let Assumption 21 hold and letp < 0, (vr, rj) from (63) 
is long-run optimal if 

(65) {l-2qp'p)Ve + {l+qp'iyi)>0. 

In the case vi = —Kp for k > 0, which still nests the models of Kim and 
Omberg (1996) and Wachter (2002), the parameter restriction in (65) sim- 
plifies as follows. 

Corollary 24. Let Assumption 21 hold. For p < and vi = —np for 
K G M. If < qp'p < 1/4 then long-run optimality holds for all k. For 1/4 < 
qp'p < 1 long-run optimality holds if 

(66) K<—^—-. 

iqp p — 1 

Thus long-run optimality requires a joint restriction on preferences (g) 
and price dynamics (p'p and k). First, since qp'p < 1, long-run optimal- 
ity always holds if k < |, that is, if risk premia have low covariation with 
changes in state variables. If this condition is not satisfied, long-run optimal- 
ity still holds regardless of the level of incompleteness (p'p) if risk aversion is 
sufficiently low {q < -g). Conversely, if the market is sufficiently incomplete 
{p'p < \), the restriction holds regardless of preferences. Hence, a violation 
of long-run optimality requires a high sensitivity of risk premia, high risk 
aversion and a nearly complete market. 

When long-run optimality fails, it does so at different scales, depending on 
parameters. The next proposition studies this phenomenon in the case k = 1, 
which corresponds to a continuous time version of the model of Summers 
(1986). 

Proposition 25. Let Assumption 21 hold. For p <0 and k = 1 from 
Corollary 24, long-run optimality holds if qp'p <j. If qp' p > j, long-run 
optimality fails. In particular: 

(i) if qp'p > J, there exists a finite T such that -E[{X^y] = — oo; 
(ii) if qp'p = I and vq = 0, the certainty equivalent loss is bounded; 
(iii) if qp'p = | and vq ^ 0, the certainty equivalent loss diverges to oo. 

4.1.1. Calibration. A calibration to real data shows that long-run opti- 
mality holds for typical levels of risk aversion, in the model with one as- 
set and one state considered by Barberis (2000) and Wachter (2002). The 
state variable represents the dividend yield and the asset is an equity in- 
dex. In the notation of this section, they use the set of parameter values (in 
monthly units) p = -0.935, r = 0.14%, a = 4.36%, i/q = 0.0788, k = 0.8944, 
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Fig. 1. Annualized certainty equivalent loss bound (m percentage points) as a function of 
the horizon (in years) of the myopic component (dashed line) and long-run optimal (solid 
line) portfolios. Both plots are obtained by equation (19) setting rj equal to the long-run 
optimal risk premium, and n equal to the long-run optimal portfolio (solid line) and to the 
myopic portfolio y^E^^/i (dashed line). Risk aversion is equal to two (p = —1, top) and 
to five (p=—4:, bottom). 



b = 0.0226. Then, condition (66) is satisfied for p > —12.4, that is, for risk- 
aversion less than 13.4. 

Figure 1 compares the finite-horizon performance of the long-run optimal 
portfolio to the one of its myopic component. The plots show the estimates 



(67) 
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of the correponding upper bounds in (19): the myopic component prevails in 
the short run but its performance progressively deteriorates as the horizon 
increases. The break-even horizon significantly increases with risk- aversion, 
passing from nine years for a risk-aversion of two, to twenty-three years 
for a risk-aversion of five. Also, the magnitude of the certainty equivalent 
loss increases with risk aversion: the differences are within one percentage 
point for a risk-aversion of two but increase to three precentage points for 
a risk-aversion of five. 

4.2. Stochastic drifts, volatilities and interest rates. The next model fea- 
tures a single state variable following the square-root diffusion of Feller 
(1951), which simultaneously affects the interest rate [Cox, Ingersoll and 
Ross (1985)], the volatilities of risky assets and their drifts. Note that the 
model is neither affine nor quadratic (due to the presence of the term with vq) 
and yet the long-run solution admits a simple expression 

' dRt = {auo + auiYt) dt + \jYto dZt, 

dYt = h{e - Yt) dt + aVYtdWt, 

d{R,Y)t = pdt, 
Kr{Yt) =ro + riYt, 

where a E M"^"; uq, ui G M"; b,9,aeR, pe M" and ro, ri G M. The parame- 
ters satisfy the following. 

Assumption 26. b, 6, a, ri > and bO > ^a^. 

Assumption 26 ensures that the state variable Y remains strictly positive, 
thereby satisfying Assumption 2 with E = (0,oo). Guessing a form of the 
solution v{y) = uology -|- viy, the main ODE (22) becomes 

q , , ,A, . 1 /■Wo \ 2t— 1 /^""o 

2 y 2\y J \y 

+ i —+vi ] {be - gap 1/0 - {b + qap'ui)y) - -a^— = \. 

Multiplying the above equation by y and setting the constant, linear and 
quadratic terms to zero leads to four candidate solutions, corresponding to 
any combination of signs in the terms ztyO and ibvA below: 

vi = ^r(b + qap'ui ± a/G), 
vq = —{-{c- qapvo) ± \/A), 



a2' 



a2 



■PTq - quQUi + -^uo'Wi - vo{b + qap'ui) + ui(66' - qapvo) 
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with 

c = be-la^, 

(68) e = {h + qap'uif + —{qu[ui - 2pn), 



A = (c - qapvfif + -rqy^VQ. 

When p < 0,ri > 0, 

e> (6 + gapVi)2>0, 
(69) 

A > [c-qap'uof > 0. 

Under P, Y has again four possible dynamics: 

dYt = {\a^ ±y/X±VQYt) dt + a^tdWt. 



The choice of — v © and v A ensures that Y satisfies Assumption 2 under P^ 
and is P^-tight in (0, oo) for each y £ (0, oo). The latter statement follows by 
the positivity of 0, A [see Pinsky (1995), Corollary 5.1.11, and the discussion 
immediately after Assumption 12]. Thus the candidate optimizer is 

r 

vi = ^r(b + qap'vi - a/O) , 

(70) VQ = ^{-{c-qap'vo) + \fK), 

A = pro - qvQVi + —vqVi - fo(6 + qap'vi) + t;i(66' - qap'vo). 
The candidate long-run optimal policies {t^,tj) are 

T^iy) = -, 5]~^(^(y) + apa{vo + viy)), r]{y) = h ^i 

1-p y 

and the candidate long-run martingale measure is 

dRt = VYiadZt, 

dYt = {b{e - Yt) - qa{p'uo + p'uiYt) +a\l- p'p){vo + v,Yt)) dt 
+ ay/YtdWt. 
Long-run optimality obtains under the following conditions. 

Proposition 27. Let Assumption 26 hold. For p < 0, long-run optimal- 
ity holds if 

(1 - 2qp'p)VX +{c- qap'uo) > 0, 

(71) _ 

(1 - 2qp'p)Ve + {b + qap'vi) > 0. 
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The main economic message of this parametric restriction is the same as in 
the previous example. Long-run optimaUty holds if either one of the following 
conditions is satisfied: the covariation of risk premia with state shocks is 
small [ap'vQ^ap'vi k, 0), the market is sufficiently incomplete {p'p<^ 1) or 
risk aversion is low (1 — p<^oo). 

5. Conclusion. Long-run analysis is a tractable and yet nontrivial frame- 
work for dynamic portfolio choice and derivatives pricing in incomplete mar- 
kets, and yields simple expressions for portfolios and risk premia. Long-run 
policies admit closed-form solutions even in cases in which finite-horizon 
policies do not, and the finite-horizon performance of long-run policies has 
a simple expression. 

Long-run optimality entails that the certainty equivalent loss vanishes for 
long horizons and requires some joint restrictions on preferences and asset 
dynamics. It does not hold at the intersection of three extreme cases: risk pre- 
mia highly CO- varying with state shocks, a nearly complete market and high 
risk aversion. Otherwise, long-run optimality holds and time-homogeneous 
portfolios are approximately optimal for long horizons. 

APPENDIX A: PROOF OF SECTION 1 

Proof of Lemma 5. Denote hy q = -^. In the case <p< 1, Holder's 
inequality with p = ^ and q = ^^y = j^ yields 

Ep[XP] = Ep[{XMYArP] < EpiiXMypf'PEpiArp^]^'^ 

because Ep[XM] < 1, and the claim follows dividing by p > 0. If p < 
(0 < g < 1) Holder's inequality with p = j^, Q = - yields 

Ep[Mi]^-P = Ep[{XMyX-i]^-P < Ep[{XMy^]'^^-P^/^Ep[X-''P]^^-P^/P 

= Ep[XM]-PEp[XP] < Ep[XP] 

and the claim now follows dividing by p < 0. In both cases, the inequality 
becomes an equality when Ep[XM] = 1 and X^"^ is proportional to M. D 



APPENDIX B: PROOFS OF SECTION 2 

Proof of Theorem 7. Since the Brownian motions Z and W are 
partially correlated, the following orthogonal decomposition holds (see the 
discussion following Assumption 2): 

(72) dZt = p{Yt)dWt + p{Yt)dBt, 
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where B = {B^,...,B^) is a n-dimensional Brownian motion independent 
of W and the matrix p{y) is defined by the identity {pp'){y) + {pp'){y) = In- 
For t > 0, define the process D by 



(73) 



Dt = £( f (-gT'S- V + (^ - qT'^-^T)Vv)\a'y^ dWt 



L 



f q{'>:-^p + ^-^TVv)'apdBt\ . 



By assumption, the operators associated to the models P and P satisfy 
Assumption 2. Since Assumption 1 also holds, Cheridito, Filipovic and Yor 
[(2005), Theorem 2.4, Remark 2.4.2] implies that for each y G £; and f > 0, P^ 
and py are equivalent on Tt with 



dpy 

(74) 



dpy 



= Dt. 



Thus, {Dt,J-t)t>o is a P^-martingale. With this notation, it suffices to prove 
that given the solution pair (f,A) to (22), with TT,r] as in (24), the follow- 
ing py almost sure identities hold: 

(75) iX^)P = e^^+^(2^)-^(^^)L»r, 

(76) (M^)-? = e(V{i-p)){AT+.(j/)-.{yT))^^. 

Indeed, if (75) and (76) hold, then (25) and (26) follow by taking expec- 
tations with respect to py . Consider first (75). Passing to logarithms, it 
suffices to prove that 

(77) plog X^- log Dt = XT + v{y)-v{YT). 
The first term on the left-hand side of (77) is 

plogX^= / ipr+pTr'p — -pir''E7r\dt+ / pir'adZf. 

Substituting vr = j^T,~^{p + TVv), the decomposition Z = pW + pB and 
collecting terms 

plogX^ = j (pr- ig(l + q)p'^-^p - q^p'^-'TVv 

(78) + ^q{l - q)Vv'T'^-^TVv] dt 
l-T i-T 

-q {p + TVvyj:-^apdWt-q {p + TVv)'^~^apdBt. 
Jo Jo 
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The second term in the left-hand side of (77) follows from (73), 



\ogDT = j (-]^q^li'T.-\L + q{l-q)ij!^-^TVv 
(79) 



]-Vv'{A + (g2 - 2q)rT.-^T)Vv ] dt 



+ / {Vv'a-q{n + TVvyi:^^ap)dWt 
Jo 

-q {fi + TVv)J:-^apdBt. 
Jo 



'0 

Subtracting (79) from (78) yields 
p log Xf — log Dt 

= I (pr- -qp'^-^n - qfi'^-^TVv + -Vv'{A - qT'^~^T)Vv] dt 

- I Vv'adWt. 
Jo 

Now, Ito's formula allows us to substitute 

(80) -[ Vv'adWt = v{y)-v{YT)+ [ Vv'bdt + -[ tr{AD^v)dt 

Jo Jo 2 Jo 

and the claim (77) follows by recalling that {v,X) solves (22). 

Consider now the equality (76). Again, by taking logarithms it suffices to 
show that 

(81) qlogU:^- log DT = -^{\T + v{y)-v{YT)). 

I — p 

The first term in the left-hand side is equal to (plugging rj = X/v and Z = 
pW + pB) 

qlogM^ = -q f rdt + qlog£(- / (S" V + S"^Tr?)VdZt 

+ / Tj'adWt) 
Jo J T 

= -q [ [r + ^/i'S" V + ^^v'{A - T'^-^T)Vv\ dt 

+ q [ {Vv'a-{p + TVvyj:^^ap)dWt 

Jo 
rT 
-q {p + TVv)T.-^apdBt 

Jo 
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and subtracting (79) yields 

qlogMJl - \ogDT = -^ [ (pr - lqfx'^~^fi - qfi'^~'TVv 
^ —P Jo \ ^ 

+ ]^v\A - qrYr^T)Vv\ dt 
Vv'adWt. 



1 '■^ 



'^-PJo 

As in the previous case, (81) now follows by substituting (80) and recalling 
that {v,X) solves (22). D 

The proof of Theorem 9 requires two lemmas. 

Lemma 28. Let (p G C{E]M.), > and let {^t)t>o be a tight family of 
probability measures on {E,B{E)). Then 

(82) lim inf - log / </) dfir > 0. 

Proof. By monotonicity, it suffices to prove the result for (f> bounded. 
Let {tn)n>i be an increasing sequence satisfying tn'l oo and 

(83) lim inf — log / (t>di^iT= Inn —log / (pd^it^- 

noo I Je n^ootn Je 

Since (j) is bounded above, the limit in (83) is nonpositive. Since the measures 
{I2t)t>o are tight, they are relatively compact with respect to the topology 
of weak convergence. Thus, up to a subsequence, there exists a probability 
measure fi on E such that 

lim / (j)dfit„= / (l)dfi £ {0,oo) 
"^^•^Je Je 

because (p is continuous, bounded and positive. Thus, for any < e < J^cpdfj,, 
there is a n^ such that n>n^ implies 

— log / (t)dnt„>—log( / (l)dfi-e/2). 

i^n Je '^n \Je J 

Hence, taking nfoo it follows that the limit in (83) is indeed 0. D 

Lemma 29. Let {Q^\^e be a solution to the martingale problem, for the 
operator L on E, where 

IffeC\E,^), f>0, i/ieni?^ [/(Ft)] </(y) + (OVsup^L/)r. 
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Proof. Let / G C^{E,R), / > 0. Since {Qy)y^E solves the martingale 
problem for L on E, the process 

/(Ft)- / {Lf){Yt)dt 
Jo 

is a local martingale under Q^. Let (rn)n>i be a reducing sequence of stop- 
ping times for this local martingale. Then 

r-TAr„ 



rl Ar„ 

E'gifiYTArJ] = f{y) + El yj^ {Lf){Yt) dt 

and the thesis follows by Fatou's lemma, taking Jifoo. D 



</(2/)+(0Vsup(L/))r 
E 



Proof of Theorem 9. Applying the inequality in (17) to equations (25) 
and (26) from Theorem 7 gives 

< liminf-(llogii;^[(A4)'?]i-^ _ ^ logi?^[(X?)^]) 



1 



(84) < limsup^^ log£;|,[(M^)'']^-P - liminf -^ log ElKX^f] 



T-5.00 



pT 



T^oo pT 



limsup^-^ log£;^. [e-CVCi-rtW^-T)] _ jij^i^f — log^^- le-''^^-^^]. 

T^oo pT P T^oo pT P 



Thus it is sufficient to prove for < p < 1 that 



(85) 



lim sup — log E^. 

T^oo T P 



exp 



1 



1 — p 



viYT, 



<0, 



(86) 

and for p < that 

(87) 



liminf -logM[exp(-i;(yT))] > 
r->-oo T P 



lim inf — log E^- 
T^oo T ^ P 



exp 



1 — p 



viYr 



>0, 



(88) 



limsup-log^|,[exp(-v(yr))] <0 



T->oo 



for p <0. The lower bounds (87) and (86) follow from the application of 
Lemma 28 to the functions (j) = exp(— j^f ) and (f> = exp(— u), respectively. 
For the upper bounds, first denote by 

Lf = V/'(6 - gT'S^ V + (^ - qT'^^^T)Vv) + ^ tv{AD^f) 

and observe that, for any a G M, 

Lie"") = ae"" (vv'{b - r^T'S" V + {A- qT'j:-^T)Vv) 
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+ -tT:{AD^v) + -aVv'AVv] 

= ae"'' ( ^^^'((1 + «)^ - gT'S-iT)Vt; + X-pr + |/i'S^ V ) , 

where the second equahty follows from (22). For p <0, consider a = — 1, 

Lie--") = e-" (^Vv'T'J^-^TVv -X + pr- |/"'5]~ ^i) • 

Assumption (ii) implies that the right-hand side is bounded by some con- 
stant K and Lemma 29 yields 

Ey^[e-<^T)^ < e-^y'^ + {K V o)r 

and hence, 

limsup;^logM [e~''(^^)] < 0. 



Similarly, for < p < 1 consider a — 



i-p' 



_j,(e-(V(i-p))«) = ^ ^-{i/{i-v))v 
1 — p 



--Vv'{A - T'S-iT)Vv -\ + pr- -/x'S^V ) 



Again, the right-hand side is bounded by K and Lemma 29 yields 

M [e-^^/^^-P))''^^^)] < e~(^/(^^P))''(j^) + (K V 0)r 

and the claim follows as in the previous case. D 

The proofs of Theorems 13 and 18 are obtained by adapting the arguments 
in Kaise and Sheu (2006) to the present setting. Because the structure of 
these proofs remains the same, the arguments are not repeated in detail, 
focusing instead on the necessary modifications. 

Henceforth, all references in italics point to Kaise and Sheu (2006). For 
ease of notation, set 

(89) A = A-qT'^~^T, b = b-qT'j:-^fi, V = pr - ^fi'^-^fi 

and define the quasilinear operator M acting on / G C'^{E) by 

(90) Mf = \ triAD^f) + ^VfAvf + b'Vf + V 

so that (22) becomes Mv = A. The following results carry over immediately 
from Kaise and Sheu (2006) and Ladyzhenskaya and Ural'tseva (1968) with 
only the obvious notational changes. 
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Lemma 30 (Lemma 2.4 and the discussion following). Let Assumption 1 
hold. Let XeM.. Then: 

(i) //, for each N there exists a vn G C'^''^{Ej\f,'K) satisfying Mv^ = A 
in Ej\f, then there exists a v £ C^''^(£^,M) satisfying Mv = A. 

(ii) If Xm — ^ A and for each m there is avm& C'^''^{E, M) solving Mvm = Xm, 
then there is a v £ C'^''^{E,'K) solving Mv = X. 

Remark 31. Note that Lemma 2.4 requires the uniform ellipticity of 
diffusion matrices in the form of conditions (Al), (A2). Under Assumption 1, 
these conditions are satisfied on each Ei\f by continuity and positivity. In the 
present setting, the conclusion of Lemma 2.4 is that, if V]\[ € C'^''^{Ej\^,'R) 
solves Mvj\f = A in Ej\f, then for each n there exist constants An,Bn, C„ > 
such that for N > 2n 

sup iV-y/vrl < max{A„ + BnX, C„}. 

En 

Lemma 32 [Theorem 8.4 in Ladyzhenskaya and Ural'tseva (1968)]. Let 
Assumptions 1 and 11 hold. For any N, if there exist functions /i,/2 G 
C^'T(£;Ar+i,M) nC(^Ar+i,M) satisfying Mfi > X and M/2 < X in En, then 
there exists a function v^ G C^''^(£'7V)]R) satisfying Mvn = A. 

Proof of Theorem 13. In Kaise and Sheu (2006) Theorem 13 is split 
into two theorems: Theorem 2.6 shows that A = [Ac, 00), while Theorem 3.2 
shows that Y is (P^)yg£;-transient for A > Ac. The following arguments show 
that the conclusions of both Theorem 2.6 and Theorem 3.2 remain valid. 

Regarding Theorem 2.6, given Lemmas 30 and 32, it suffices to prove 
that: 

(A) There exists a Aq G K such that for each N there is a vn G C'^'^{En,^) 
satisfying Mvn = Aq in En ■ 

(B) The set {A G M : 3u G C'^^^{E,R) satisfying Mv > A} is unbounded 
from above. 

(C) Ac = inf A> -00. 

Indeed, if (A) holds true then Lemma 30 yields a solution v G C'^''^{E,'R) 
to Mv = Ao proving A / 0. Now, let A G A, let u G C^'^^iE, M) satisfy Mv = X 
and let A > A. If (B) holds, then there is a /i G C^^^{E, M) satisfying M/i > A. 
Thus, with /2 = v, Lemma 32 applies for any N and hence, by Lemma 30, 
it follows that A G A. Thus, A G A =^ [A, 00) C A. By (C) it follows that A 
is bounded from below and by Lemma 30 it follows that A is closed. Thus, 
A = [Ac, 00) is the desired result. 

Therefore, it remains to prove (A), (B) and (C). First, note that with a, a 
the unique symmetric, positive definite square roots of A and S, respectively, 
it follows that 

A = a{lk - qpp)a = (1 - q)aa + qa{lk - p p)a. 
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By construction 1„ — pp' > and hence, Ifc — p' p > 0. Thus, setting 

1-q, p<0, -=P' ^^°' 

1, 0<p<10, ^ \l-q, 0<p<l, 

it follows that c, c > are such that on E 

(91) cA<A< cA. 

Define the linear operators L^ and L'^ acting on / G C'^{E) by 

L'^f = \ tT{AD^f) + b'Vf + cVf, L'f = i triAD^f) + b'Vf + cVf. 

Let A* and A* denote the generalized principal eigenvalue for L'^ and L^ 
on E [Pinsky (1995), Chapter 4.3]. Assumptions 1, 11 and 12 imply that A*, 
A* G R. By (91), it follows that 

(92) -L'9<Mf<^L'g, 

eg eg 

where g = e"^ and g = e^f . For any /3 > max[A*, A*, 1], let A = |(i + \). 
By construction there exist g,g ^ C'^''^{E), g,g > satisfying L'^g = /3g and 
L^g = I3g in E. Set fi = \ logg. By (92), it follows that on E 

eg 2 \c cj 

Similarly, setting /2 = glog^ and using (92) it follows that on E 

M/2 - A < ^_L^-g - A = § f ^ - -") < 0. 
eg 2 \c cJ 

Therefore, (A) holds by first applying Lemma 32 and then Lemma 30 (i) for 
Aq = A. Furthermore, since (3 can be taken arbitrarily large, (B) holds as 
well. Regarding (C), let A G A and let v be the associated function solving 
Mv = \ and let g = e""" . By (92) 

,_ , 1 fL^g\ 1 , (L^9\ A* 
A = sup [Mv) > -sup ] ^ - lilt sup = — , 

E C E \ 9 J CgeC^E,R) E \ 9 J C 

g>0 

where the last equality follows by Pinsky (1995), Theorem 4.4.5. Thus Ac > 
— oo. 

Regarding Theorem 3.2, note that by (91), Remark 2.1 holds for c, c and 
the argument in Lemma 3.1 carries over exactly, up to obvious changes in 
notation. D 

Before proving Theorem 18, the following definitions and results are needed 
from the theory of large deviations for occupancy times of diffusions. Let 
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Assumptions 1, 11 and 12 hold. To make the dependence upon A specific, for 
A G A let {P^'y)y^E be the measure in Theorem 7 and let L^ be the operator 
associated to {P^'y)y^E- Let Mi{E) denote the space of Borel probability 
measures on E. Define the function I : Mi{E) i— t- M by 

A. 



ueUjE u 



where 



U=\u£C''^{E,R) u{x) > e« > 0, bounded 



It is clear that / is nonnegative (u = 1) and lower semi-continuous with 
respect to the weak topology on Mi{E) [L u/u is bounded). Set r^ = inf{t > 
: Yi G E^} and r = lim„-|-oo r„,. Denote by ^t the occupation measure for Y 
on {T < r}, which satisfies 

1 r 

fiT{B) = 7^ lYteB dt for all T < r and aU Borel B(1E. 
T Jo 

For compact K C Mi{E), it follows that for all y € £^ [Donsker and Varadhan 
(1976), Section 7], 

(93) hm sup ^ log P^^y {fir & K,T < t) < - inf I^{fi). 

Furthermore, the following facts hold. 

Lemma 33. Let Assumptions 1, 11 and 12 hold. If there exists a ^* £ 
Mi{E) such that I^{fi*) = 0, then for all y G E, P^'y{T = oo) = 1 and n* 
possesses a C'^'''{E, M) density g* , such that L^g* = 0, where L^ is the formal 
adjoint to L . 

Proof. That P^'y{T = oo) = 1 for all y G £■ follows by repeating the 
argument in Lemma 3.5 up to, and through the point where P^'^(r = oo) = 1 
for n* a.e. y€E. By Pinsky [(1995), Theorem 1.15.1], the same conclusion 
can be extended to all y G £^. 

As for the second statement, the argument in Lemma 3.6 can be repeated 
up to and including the point where it is shown that /(//*) = implies 
Jg, L^w{x)fi* (dx) = for all w G C^ (S, M) . Thus the conclusions follow from 
Pinsky (1995), page 181. In particular, f^g*dy = l< oo. D 

Proof of Theorem 18. As in the proof of Theorem 13, the proof 
of Theorem 18 adapts the results in Kaise and Sheu (2006) to the present 
setting, now extending Theorem 3.7 and Theorem 3.8. Theorem 3.7 yields 
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that for A = Ac, Y is (P^)ygs-positive recurrent, while Theorem 3.8 states 
that the solution Vc corresponding to Ac is unique up to an additive constant. 
Theorem 3.8 carries over with only notational changes, in the light of (91) 
and Lemma 30. 

Theorem 3.7 is composed of three parts. The first part (Proposition 3.3) 
states that if Y is transient under {P 'y)y^E, then there exists a > such 
that for all f eCo{E),f>0, y£E, and T large enough 

(94) El^[fiYT),T<T]<Ciy)e~'^^. 

The second part uses the first part to show that Y is recurrent under (P^^'y). 
The third part states that Y is actually positive recurrent. The argument 
used to prove the second part (recurrence) carries over unchanged, hence, 
details are provided on the first and third parts. 

As for the first part (Proposition 3.3) assume that Y is transient under 
{P^^y)y^E- Consider the set C^ = {a* S Mi{E) : n{Ei) >l-5iyi> m}. To 
construct the constants 6i, set 

Uo = -{V + ^Vw'AVw + b'Vw + i tiiAD^)) 

for the function w from Assumption 16. Note that by (36), 

lim inf C/o(y) = oo. 

ntoo y&E\En 

Let cbe as in (91). Set /3o= iniy^E c{Uo{y) + A) and /?; = inf y^E\Ei c{Uo{y) + A). 
Let M > and set 

. M + I^ol 
Oi - 



|/3o|+A' 

Since /?/ f c«, it follows that 5/ 1 and hence, the set Cm is relatively compact 
(weak topology) for m large enough, so that /3m > and 5m < 1- Set = 
exp(c(tt; — v)) where v is such that Mv = A. Then, repeating the arguments 
in Proposition 3.3, it follows that for any / G Cq{E) [equation (3.22)], 



EUfiYT),T<T]<sup\f\ P^'^[^TGC,„,r<T] + sup|//<^| ^{y)e 

^ E E 



By (93) it follows, after taking M t oo that 

(95) limsup;^logii;^J/(yT),T<r]<- inf /^(/i). 

Ttoo -f M6C,„ 

Now, since I"^ is lower semi-continuous and Cm is compact, — inf g^^ I^il^) = 
—I^{n*) for some //* G Cm- 
It is now shown that I^ifi^*) > 0. Suppose, by contradiction, that /'^'(/U*) = 
and that Y is transient under {P^'y)y^E- Since I^{fi*) = 0, Lemma 33 implies 
that: 

(a) P^'y[T = oo] = 1 for all yeE. 
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(b) With L^ denoting the adjoint operator to L'^, there exists a C'^''^{E, M) 
positive function g* such that L^g* = and f^g*{x) dx = 1. 

However, Pinsky [(1995), Corohary 4.9.4] imphes that if Y is transient un- 
der {P^'y)y^E and there exists some cj) G C'^''^ {E ,]S.) , (f> > which satisfies 
L^(j) = 0, then J^ (j) dy < oo imphes P^'^It < oo] > for all y ^ E. This con- 
clusion contradicts (a) above. Thus, I^{fi*) > and, in view of (95), the 
inequality in (94) holds for any < a < / (/i*) and large enough T. 

To show the third part [positive recurrence for Y under (P '^)yg£;], the 
same steps as in part one can be repeated to obtain (95), as these steps 
do not require that Y is transient. Now, if inf g^j^ -^^(m) > 0) then for all 
/ e Co{E), (94) implies that 



/•oo 

J El^[f{YT),T<T]dT <oo, 



in which case Y is transient under {P'^'y)y^E [Pinsky (1995), Chapter 4.2]. 
But part two implies that Y is recurrent. Thus, there is a //* G Cm such 
that I^{^*) = 0. Since fi* is a probability measure, ergodicity follows by 
Lemma 33. D 

Proof of Proposition 19. The invariant density for Y under {py)y^E 
IS (j) = (f)1mu where 0c = exp(z;c/(5) and niy is from (34). Equations (25) 
and (26) from Theorem 7 become 

El[{X7j.Y]=e^''+<y^El[cP,{YT)-\ 

El[{Ml^yY-P = e^^+<y^ El[<j)c{YT)-^'^^-P^f-^ . 

Since j^ rriy dy < oo, f^ (j)lmi, dy < oo, it follows that 

(l)~^(j)lmy dy <oo, / ^^T^/^^^^^^^mi, dy < oo 

E Je 

provided that 2 — 5 > and 2 — j^— > 0. These conditions are equivalent to 
those in (39). Thus, by the ergodic result (30) it holds that 

hmEl[MyTr']= I <Pc'^lm,dy^K, 
T^too -f" Je 

limM[<Ac(l^T)-'/('"^)]'-^= I (t^-J'^^-^Ulm^dy^K^ 
Ttoo -^ Je 

and long-run optimality follows. Furthermore, in light of (19), the conclusion 
in (40) follows with K=^ \og{K-2/Ki). D 



a, 
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APPENDIX C: PROOFS OF SECTION 4 

Proof of Theorem 22. If vq e IS} and vi G R''^'^, vi symmetric sol- 
ve (55) and (56), respectively, then v{y) = v'^y — \y'viy solves (22) for A 
from (57). Under Assmnption 21, the condition (37) holds, hence. Theo- 
rems 13 and 18 imply that, if for v the associated process Y is P^-tight 
in M*^ for each y G M'^, then v is the desired solution. The Riccati equa- 
tion (56) admits the form 

uiBB'ui - ui A - A'ui - C'C = 

with 

B = (A-grs-iT)i/2; A = -(6 + grs-Vi); C = ^CT-Vi, 

where B is assumed to be the unique symmetric positive definite square root 
of A — gT'S~^T. C is a real valued matrix when p < 0. For a real valued 
square matrix M, write M > if M -|- M' is strictly positive definite. If 
M > 0, then the real part of each of its eigenvalues is strictly positive. To 
see this, let x,A such that Mx = Ax. Then (with x denoting the complex 
conjugate of x) 

< x'{M + M')x = x'Xx + Xx'x = 2|xp Re[A]. 

From Abou-Kandil et al. [(2003), Lemma 2.4.1], if there exist two matrices 
Fi G R^^'^ and Fa G W^ such that A - BFi < and A' - C'Fs < 0, then 
there exists a unique solution vi such that A — BB'wi < 0. Since 6 > and 
p < 0, the choice of Fi = — gB~^T'S~^/ii and F2 = — y^pa' suffices. The 
condition A — BB'ui < yields 

(96) - ((6 + gT'E" Vi) + (^ - gT'S-iT)t;i) < 0. 

Therefore, 

{vi{A - (^T'S^^T) + {h + gT'S- Vi)') 

= ((6 + (/T'S- Vi) + {A- qr'^~^T)vi)' > 

has eigenvalues with strictly positive real part and is invertible. Thus vq 
from (55) is well defined. It remains to prove that (lt)t>o is P^-tight in R*^. 
Under P^, Y has the dynamics 

dYt = (-((6 + (/T'S- Vi) + {A- qr^-^T)vi)Yt 

- gT'E" Vo + {A- gT'S-^T)i;o) dt + a dWt. 



Setting 



D = ((6 + gT'S- Vi) + (^ - qT'T.-^T)vi), 
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the dynamics takes the form 

dYt = D(E - Yt) dt + adWt, 

where D e M^'^'^ is such that D > and E G M''. For Zt = Yt - E it follows 
that 

dZt = -'DZtdt + adWt. 

Since 

(97) |ytp<2|E|2 + 2|Zj|2, 

is suffices to show that {Zt)t>o is -P^-tight in R , which follows because any 
compact set is contained in a closed ball around the origin, and by (97) if Zt 
is in a closed ball around 0, then so is Yf. Using the methods derived in 
Bhattacharya (1978) it follows that under {py)y^E, Z is positive recurrent. 
To show this, let A* and A* denote the maximum and minimum eigenvalues 
of ^ = aa' and let 0* denote the minimum eigenvalue of D + D'. Since D > 
and by Assumption 21, ^4 > it follows that A* > and 9^ > 0. Furthermore, 

inf x'Ax = X^ inf x'Dx = 0*. 

a;:|a;|=l a:::|2;|=l 

Thus, with the notation of Pinsky [(1995), Theorem 6.2], a(r) = A* and 

-, , tr(A) - x'Ax - Ir^x'Tix tr(A) - A* - Ir^Q^ 
/3(r)= sup — < , 

x:\x\ = \ x'Ax A* 

where the last inequality follows for r large enough so that the numerator is 
negative. Therefore, Pinsky [(1995), Theorem 6.2] applies and Z is positive 
recurrent. D 

Proof of Proposition 23. In light of Theorems 22 and 9, it suffices 
to show that for p < the following quantity is bounded as a function of y: 

{pro - A - lq{iJQ + bv[y){uQ + bviy) 
(98) 

+ \qp'p{vo - viyf)e-''^y+^^l^>^y\ 

Note that, for p < 0, in (62) satisfies 

(99) Q>{l + qp'uif. 

Therefore, 

Vi=b5[VQ-{l+qp'ui))>^ 

and (98) is bounded over M only if the quadratic term is negative 

12/ 1 1,2 / , n 

2^^1/0 p — 21" Z^l^^l < 0. 
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But 

\qvlp'p - ^qb^v'^vi = \qp' pd^lP' {VQ - (1 + qpi^i)) 
-\hH{Q-{l+qp'vif) 
= \5h\^-{l + qp'ui)) 



2" 

^{{2qp'p-l)VQ-{l + qp'vi)). 

From (65), the quantity {2qp' p — l)v0 — (1 + qp'vi) is negative, while 
|(5^6^(\/0 — {^ + qp'^i)) is positive by (99). Therefore, the leading quadratic 
term is negative and the result follows. D 

Proof of Corollary 24. When vi = —np condition (65) reduces to 

(1 - 2qp'p){l + qp'p{K^ - 2k))^/2 + (1 - qnp' p) > 0. 

Set X = qp'p and consider the continuous function 

f{x, k) = (1 - 22;)(1 + x(k2 - 2k))^/^ + (1 - kx) 

on 0<x<1,k;GM. For a fixed < x < 1 consider the implicit equation 
for K obtained by setting f{x,K) = 0. For < x < ^ one can show there are 
no K G M such that f{x,K) = 0. For j < x < 1, f{x,K) = only along the 
curve K = ^^_i - For a fixed x and large positive k 

f{x, k) ^ k((1 - 2x)^/x -x) <0 

and for large negative n 

f{x,K) ^ \k\{{1 - 2x)^ + x) > 0, 

therefore, plugging back in qp' p for x, for j < qp'p < 1 the restriction k < 
4gp/p_i is necessary. D 

Proof of Proposition 25. When k = 1, by Corollary 24, long-run 
optimality holds for < qp' p < -g. For ^ < qp' p < 1 long-run optimality holds 
if 1 < . ? -^ or qp'p < |. Consider now qp'p > |, which is equivalent to 6 >4 
since 6 = — — — ■ When k = 1 the solution vi , vq and simplify considerably 
to = 5~^; vi = b{v5 — 1); and vq = qSp'uQ. Under P, Y has the dynamics 

dYt = —^Ytdt+dWt. 
yd 



2b 



For Yq = y, it follows that Yt ~ N{pt,(Tt) with pt = ye"^/^*, and cr| 
(l-e-sfc/v^*). Therefore, 



M [e-^(^')] = i^[exp(Ay/ + ^Yt)l 
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where A = 1(^/^-1), B = -q6p'iJo. Foi X ^ N{^i,a'^), 

(100) 

' (1 - 2A(j2)-i/2 exp((l - 2Acj2)-i(/i2A + fiB + ia^B^)), 

Therefore, E^[e-''('^*)] < oo if and only if ^{^/6 - I) < ^. This condition 
reduces to 

(101) 1 + ^(1 _ V5)(l - e-(2Vv^)t) > 0. 

Note that the left-hand side of (101) is equal to 1 at i = and monotonically 
decreasing in t for 6 > 1. Setting this expression equal to 0, and solving for t 
yields 

V5^ fVd{VS-l)-2 

' = -^H V6iVs-i) 

If \/5{^/5 — 1) > 2 or equivalently, 6 > 4, then i> exists. This proves state- 
ment (i) in Proposition 25. If 5 = 4, the left-hand side of (101) reduces to 
e"''* > for aU t > 0. Thus, 

£;^[e-(^*)] = exp Q(t + y') - 4qp'uoe'^''y + IqHp''^o)\1 - e-^*)e^*) . 

On the other hand, for 5 = 4, it follows that £;|^[e-(i/(i-P))^(^*)]i-P < oo if 

' -e-^*>0 



2 2(1 -p) 
which is true for all t > because 5 = 4 only when <q < 1. Thus 

^3{[e-{i/(i-p))«m)]i-P 

= (l-(l-g)(l-e-^*))-(^-^)/' 

X exp ((l-p) QkI - q)yh-'' -Aq{l- q)p'uoe-'/^' 



y 

2/1 „\2/ /,, \2n „-bt\ 



+ p'{l-qr{p'i^or{l-e 



/(l_(l_g)(l_e-)) . 
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b4 



If 1^0 = 0, E|,[e-^(^*)] ~ Ke2^ and ^|[e-(i/(i-p))''(^t)]i-p ^ g-(i-p)/2 fo^ lar- 
ge t, so the certainty equivalent loss is bounded by —2^, proving (ii) in 
Proposition 25. 

If z^o / 0, then £;|[e-^(^')] ~ e^^^" and £;|[e-(V(i-p))t'{i^'0]i-p ^ g-(i-p)/2eX2 
for large T, where Ki,K2 are positive constants. In this case, the certainty 
equivalent loss diverges to —00 with speed of the order of —j^e- This proves 
(iii) and the proof is complete. D 

Proof of Proposition 27. Since vo,vi satisfy (70), v{y) =vology + 
viy solves (22). Under P the dynamics of Y are 



dYt = Ve{ '^ + (1/^)" -Yt]dt + aWYtdWt 



and, as mentioned in Section 4.2, the positivity of 0,A give that Y is P^- 
tight in (0,oo) for each y G (0,oo). 

Therefore, long-run optimality will follow if the quantity F for p <0 from 
Theorem 9 is bounded over (0, oo). Specifying to this example, it is necessary 
to show that 

^ 1/1 

pro+pny- X- -q{vQ + yui)-{vQ+yvi) 

\ ^ y 

(102) ' 

is bounded on y > 0. This expression admits the form 

(A + By + Cy2)y--o-ig-.iy, 

For vq, vi from (70), by (69) it follows that uq > 0, t;i < and so (102) will 
follow only if A < 0, C < 0. As for A, 

A = -qa^p'pvl - -qy^vo 

= 2^"^^'^;^ ( VA - [he- qap'uo " 2 °^ ) ) 



From (71) 



'- 2~[^~ [he -qap'vQ- -a^ 
X {(2qp'p -l)^-(he- qap'uQ - ]^aA \ . 

{2qp'p - 1)\/A - (he - qap'uQ - ^a^) < 0. 
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Thus, A < since by (69) 

-^(\/A- (b6-qapuo--aA] > 0. 



As for C, 



r^ 1 2 / 2 , 1 / 

C = -qa p pvi +pri - -qv^vi 



= \qa^p'p^l{{b + qap'vr) - ^/^f + ~{{h + qap'v^f - 6) 

^ ill ^ (Jj 

= ~{{b + qap'vi) - Ve)((l - 2qp'p)VQ + {h + qap'ui)). 
2 a^ 

From (71) 

(1 - 2qp'p)^+{h + qap'vi) > 0. 

Thus, C<0, since by (69), 

1 6"^ 

-^{{b + qap'i^i)-Ve)<0. n 
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